Self-supervised Graph-level Representation Learning with Adversarial Contrastive Learning
نویسندگان
چکیده
The recently-developed unsupervised graph representation learning approaches apply contrastive into graph-structured data and achieve promising performance. However, these methods mainly focus on augmentation for positive samples, while the negative mining strategies are less explored, leading to sub-optimal To tackle this issue, we propose a Graph Adversarial Contrastive Learning (GraphACL) scheme that learns bank of samples effective self-supervised whole-graph learning. Our GraphACL consists (i) encoding branch generates representations (ii) an adversarial generation produces samples. generate more powerful hard our method minimizes loss during updating maximizing adversarially over providing challenging task. Moreover, quality produced by is enhanced through regularization carefully designed divergence orthogonality loss. We optimize parameters alternately. Extensive experiments fourteen real-world benchmarks both classification transfer tasks demonstrate effectiveness proposed approach existing methods.
منابع مشابه
GraphGAN: Graph Representation Learning with Generative Adversarial Nets
The goal of graph representation learning is to embed each vertex in a graph into a low-dimensional vector space. Existing graph representation learning methods can be classified into two categories: generative models that learn the underlying connectivity distribution in the graph, and discriminative models that predict the probability of edge existence between a pair of vertices. In this pape...
متن کاملTime-Contrastive Networks: Self-Supervised Learning from Video
We propose a self-supervised approach for learning representations and robotic behaviors entirely from unlabeled videos recorded from multiple viewpoints, and study how this representation can be used in two robotic imitation settings: imitating object interactions from videos of humans, and imitating human poses. Imitation of human behavior requires a viewpoint-invariant representation that ca...
متن کاملSemi-Supervised Learning with Generative Adversarial Networks
We extend Generative Adversarial Networks (GANs) to the semi-supervised context by forcing the discriminator network to output class labels. We train a generative model G and a discriminator D on a dataset with inputs belonging to one of N classes. At training time, D is made to predict which of N+1 classes the input belongs to, where an extra class is added to correspond to the outputs of G. W...
متن کاملLearning Graph-Level Representation for Drug Discovery
Predicating macroscopic influences of drugs on human body, like efficacy and toxicity, is a central problem of smallmolecule based drug discovery. Molecules can be represented as an undirected graph, and we can utilize graph convolution networks to predication molecular properties. However, graph convolutional networks and other graph neural networks all focus on learning node-level representat...
متن کاملWeakly-Supervised Learning with Cost-Augmented Contrastive Estimation
We generalize contrastive estimation in two ways that permit adding more knowledge to unsupervised learning. The first allows the modeler to specify not only the set of corrupted inputs for each observation, but also how bad each one is. The second allows specifying structural preferences on the latent variable used to explain the observations. They require setting additional hyperparameters, w...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: ACM Transactions on Knowledge Discovery From Data
سال: 2023
ISSN: ['1556-472X', '1556-4681']
DOI: https://doi.org/10.1145/3624018